REPORT  DOCUMENTATION  PAGE 

Form  Approved  OMB  No.  0704-0188 

Public  reporting  burden  for  this  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  the  burden,  to  Department  of  Defense,  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports  (0704-0188),  1215  Jefferson 
Davis  Highway,  Suite  1204,  Arlington,  VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  any  penalty  for  failing  to  comply 
with  a  collection  of  information  if  it  does  not  display  a  currently  valid  OMB  control  number. 

PLEASE  DO  NOT  RETURN  YOUR  FORM  TO  THE  ABOVE  ADDRESS. 

1.  REPORT  DATE  (DD-MM-YYYY)  2.  REPORT  TYPE 

13-11  -2003  Final  Report 

3.  DATES  COVERED  (From  -  To) 

28  June  2002  -  28-Apr-03 

4.  TITLE  AND  SUBTITLE 

A  Multipurpose  Foveated  PAL  Optic  Based  on  Humanoid  PAL 

5a.  CONTRACT  NUMBER 

F61 775-02-WE039 

5b.  GRANT  NUMBER 

5c.  PROGRAM  ELEMENT  NUMBER 

6.  AUTHOR(S) 

Edith  M.  Greguss  (successor  to  Prof.  Pal  Greguss) 

5d.  PROJECT  NUMBER 

5d.  TASK  NUMBER 

5e.  WORK  UNIT  NUMBER 

7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

OPTOPAL  Panoramic  Metrology  Consulting 

Csiksomlyo  u  4. 

Budapest  H-1025 

Hungary 

8.  PERFORMING  ORGANIZATION 

REPORT  NUMBER 

N/A 

9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 

EOARD 

PSC  802  BOX  14 

FPO  09499-0014 

10.  SPONSOR/MONITOR’S  ACRONYM(S) 

11.  SPONSOR/MONITOR’S  REPORT  NUMBER(S) 

SPC  02-4039 

12.  DISTRIBUTION/AVAILABILITY  STATEMENT 

Approved  for  public  release;  distribution  is  unlimited. 

13.  SUPPLEMENTARY  NOTES 

14.  ABSTRACT 

This  report  results  from  a  contract  tasking  OPTOPAL  Panoramic  Metrology  Consulting  as  follows:  The  contractor  will 
investigate  advancements  to  the  PAL  optic  from  earlier  research  (SPC  014009)  which  developed  the  design  principles  of  a 
catadioptric  imaging  block,  called  the  Panoramic  Annular  Lens  (PAL).  PAL  delivers  a  360-degree  panoramic  view  of  the  3D 

environment  surrounding  the  optic.  Advanced  optic  modeling  indicated  that  a  well-defined  cylindrical  volume  around  the 
optical  axis  of  the  PAL  imaging  block  is  not  essential  to  formation  of  the  ring-shaped  panoramic  image.  This  suggested  that 
removal  of  part  of  the  reflective  coating  of  the  concave  surface  around  the  optical  axis  would  give  a  transparent  view  down 
the  optical  axis.  A  straightforward-looking  optic  (SFLO)  mounted  on  the  optical  axis  of  PAL  then  allows  an  image  to  be 
displayed  where  no  optical  information  is  otherwise  present.  A  rotating,  inclined  mirror  placed  in  the  optical  axis  allows 
steering  of  the  SFLO  to  any  portion  of  the  360-degree  ring-shaped  panoramic  image.  This  is  called  the  Humanoid  PAL  (or 
HPAL,  foveated  PAL)  because  it  acts  similar  to  human  vision  creating  a  foveal  image  allowing  extraction  of  more  detailed 
optical  data. 

15.  SUBJECT  TERMS 

EOARD,  Optical  Components 


16.  SECURITY  CLASSIFICATION  OF: 

17.  LIMITATION  OF 
ABSTRACT 

UL 

18,  NUMBER 
OF  PAGES 

7 

19a.  NAME  OF  RESPONSIBLE  PERSON 

CHRISTOPHER  E  REUTER,  Ph.  D. 

a.  REPORT 

UNCLAS 

b.  ABSTRACT 

UNCLAS 

c.  THIS  PAGE 

UNCLAS 

19b.  TELEPHONE  NUMBER  (Include  area  code) 

+44  20  7514  4474 

Standard  Form  298  (Rev.  8/98) 


Prescribed  by  ANSI  Std.  Z39-18 


Final  Report:  A  Multipurpose  Foveated  PAL  Optic  Based  on  Humanoid  PAL 


Final  Report 

of  the  Project  SPC  02-4039 ,  Contract  Order  No.  F  61 775-02  WE009 

entitled 

“A  Multipurpose  Foveated  PAL  Optic  Based  on  Humanoid  PAL  ” 

Introduction 

1.  The  scope  of  this  project  as  a  follow-up  project  of  the  earlier  works  on  Humanoid 
PAL  (SPC-99-4065  and  SPC-01-4009,  respectively)  was  to  design,  to  manufacture  and  to  de¬ 
liver  to  AnaLogic  Computers  Ltd.  (in  care  of  Dr.  Akos  Zarandy)  a  multipurpose  foveated  PAL 
optic  and  rotating  mirror  system  an  enhanced  vision  module  (including  the  lens,  the  mechani¬ 
cal  components  and  the  program  for  controlling  the  motor  that  rotates  the  mirror)  with  char¬ 
acteristics  as  specified  in  the  technical  proposal. 

2.  The  original  contractor  of  this  contract,  Professor  Pal  Greguss  passed  away  sud¬ 
denly  due  to  a  tragic  accident.  His  one  person  research&development  enterprise  OPTOPAL 
Panoramic  Metrological  Service  is  continued  by  his  wife,  Mrs.  Edith  Greguss  -  his  closest  co¬ 
worker  and  research  mate  during  six  decades  -  using  her  widows’  rights  with  the  professional 
help  of  their  son,  Mr.  Pal  Greguss,  Jr.,  physicist,  of  his  closest  co-worker  in  the  recent  years, 
Mr.  Janos  Komiss,  electrical&software  engineer  and  research  physicist  in  optics,  and  of  his 
grand  son,  Mr.  Tamas  Greguss,  electrical&software  engineer.  This  final  report  was  composed 
and  the  whole  work  was  finalised  by  his  son,  Pal  Greguss,  Jr. 

3.  Reviewing  his  works  just  after  his  death,  it  seemed  to  us  that  the  work  necessary  to 
complete  this  contract  was  almost  ready,  the  apparatus  being  left  on  his  workbench  was  wait¬ 
ing  only  the  final  assembly  and  adjustments  and  to  forward  it  to  Mr.  Akos  Zarandy’ s  research 
group  till  28th  of  April  2003.  . 

4.  At  the  beginning  of  April  there  was  held  a  meeting  at  AnaLogic  Computers  Ltd.  to 
investigate  the  final  fulfillment  of  the  task.  There,  however,  it  was  realized,  that  the  arrange¬ 
ment  being  formed  following  the  specifications  of  the  contract  and  using  the  lens  already  pur¬ 
chased  for  relay  optics  fulfilling  the  specifications  being  undertaken  didn’t  fit  well  to  the  C 
mount  2/3  “  CCD  camera  (a  DALSA  product)  purchased  meanwhile  by  the  recipient  part¬ 
ner,  as  the  original  undertaking  of  contract  was  the  shipping  a  humanoid  PAL  optics  with  a 
rotating  mirror  with  a  stepper  motor  fitting  to  a  CICS-mount  V2  “  CCD  camera. 

5.  The  above  problem  was  overcome  and  it  will  be  discussed  later  in  details.  The  en¬ 
hanced  vision  module  has  been  delivered  to  AnaLogic  Computers  Ltd.  on  28th  of  October, 
2003. . 
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Summary  of  previous  works 

Feasibility  studies  of  the  projects  SPC-99-4065  and  SPC-01-4009,  respec¬ 
tively,  have  laid  down  the  theoretical  background  how  centric-minded  imaging  (CMI)  could 
be  adapted  to  some  military  video  systems.  The  design  principles  of  a  catadioptric  imaging 
block,  called  Panoramic  Annular  Lens  (PAL)  have  been  outlined.  PAL  delivers  a  360°  pano¬ 
ramic  view  of  the  3D  environment  surrounding  the  optic.  Placing  a  straitforward-looking  op¬ 
tic  (SFLO)  in  the  optical  axis  of  PAL,  on  that  part  of  the  ring-shaped  PAL  image  where  oth¬ 
erwise  no  optical  information  is  present,  an  image  will  be  displayed.  This  version  of  PAL 
was  called  humanoid  PAL  (HPAL).  Placing  a  rotatable  mirror  in  the  optical  axis  of  HPAL, 
any  predetermined  portion  of  the  360°  ring-shaped  panoramic  image  of  the  3D  space  can  be 
displayed.  Thus,  this  system  acts  similarly  to  the  human  vision;  it  creates  a  foveal  image  to 
be  able  to  extract  more  detailed  optical  data.  This  is  why  this  system  is  referred  to  as  foveated 
PAL. 

The  proposed  characteristics  of  the  vision  module  to  be 
delivered  to  EOARD: 


1 .  The  diameter  of  the  vision  module  will  be  around  40  mm. 

2.  The  height  of  the  vision  module  will  be  around  80  mm. 

3.  The  vision  module  will  use  C-mount. 

4.  The  diameter  of  HPAL  will  be  around  26  mm. 

5.  The  total  horizontal  viewing  angle  of  HPAL  will  be  around 
80°. 

6.  The  SFLO  will  provide  about  4x  enlargement. 

7.  The  front  surface  mirror  will  be  rotated  by  an  off-the-shelf 
stepping  motor,  and  will  be  controlled  via  a  PC  program. 

8.  The  vision  module  can  be  adapted  via  C-mount  to  various 
off-the-shelf  CCDs  by  choosing  adequate  off-the-shelf  relay 
lenses. 

Panoramic  versus  Foveal  image 


Since  the  intention  with  HPAL  is  to  use  a  single  image  sensor  for  capturing  both  the 
360°  panoramic  image  (green  area)  and  the  selected  foveal  image  (violet  area),  we  have  to 


know  the  pixel  area  ratio  of  these  two  pictures. 

The  surface  area  of  the  image  sensor  covered  by 
the  panoramic  image  is  about  3.37  times  bigger  than 

that  of  the  foveal  im¬ 
age.  Anyone  should 
always  keep  this  fact 
in  mind  when  a  cam¬ 
era  is  chosen  for  a 
given  task.  This  is 
especially  true  when 
a  system  includes  a 
CNN-UM  focal 
plane  array  processor 
chip. 
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As  for  an  example  in  the  case  of  an  IBIS5  1.3  Mpixel  CMOS  Image  Sensor,  where  the 
resolution  and  pixel  size  result  in  a  2/3”  optical  format,  the  360°  panoramic  image  will  cover 
about  535,753  pixels  of  6.7  pm  x  6.7  pm  size,  while  the  foveal  image  will  occupy  around 
226,056  pixels  of  the  same  size. 

Consulting  with  A.  Zarandy  of  AnaLogic  Computers  Ltd.  we  have  learned  that  a  new 
CNN-UM  focal  plane  array  processor  chip  with  higher  resolution  is  still  not  available  and, 
therefore,  they  are  looking  for  a  CMOS  camera  capable  of  shooting  at  least  1000  frames/sec. 

Since  then  we  were  notified  that  AnaLogic  Computers  Ltd.  has  purchased  an  IBIS5 
Dual  Shutter  Mode  1.3  Mpixel  CMOS  Image  Sensor  and  a  DALSA  camera. 

The  features  of  this  image  sensor  and  camera  relevant  to  our  task  are  that  they  have 
optical  format  of  a  2/3”  and  C  mountable  fittings.  From  other  sources  you  can  see  that  re¬ 
cently  the  trend  of  the  development  of  the  high  resolution  CCD  cameras  is  to  increase  the  op¬ 
tical  format  instead  of  decreasing  the  pixel  sizes. 

Elements  of  the  vision  modul  connected  to  the  CCD  camera 


There  are  four  structural  elements:  motor,  mirror,  HPAL,  relay  lens. 
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The  first  structural  element 

is  the  Stepper  Motor 

To  rotate  the  front 
surface  mirror  we  chose  a 
stepper  motor  that  is  not  as 
sophisticated  as  the  US- 
motor  we  used  in  our 
preliminary  experiments 
reported  in  SPC  01-4009, 
however,  it  weighs  less, 
which  makes  it  easier  to 
move  HPAL  from  one 
camera  type  to  another. 
Nevertheless,  this  motor  as 
well  is  controlled  via  a 
software  we  developed. 


As  it  can  be  learned  from  its  control  panel 
shown  below,  not  only  the  rotating  direction  of  the 
inclined  mirror  can  be  chosen  at  will,  one  can  also 
select  in  advance  the  direction  of  the  foveal  view, 
determine  the  stepping  rate  of  the  mirror  with  vari¬ 
able  inclination;  etc. 


Fig.  2.  The  stepper  motor 
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The  second  structural  element  is  the  rotatable  and  tiltable 
front  surface  mirror. 

To  be  able  to  select  from  the  360°  panoramic  view  any 
foveal  image  direction  at  will,  the  rotating  front  surface 
mirror  has  to  have  a  mount  that  allows  changing  the  mirror 
inclination  angle  with  respect  to  the  optical  axis  of  the 
system. 


Fig.  3.  The  inclination  angle  may  be  changed  using 
screws  in  this  hole  and  another  one  in  a  hole  on  the 
other  side 


The  third  structural  element  is  the 
HPAL  Humanoid  Panoramic 
Annular  Lens,  consisting  of  two 
parts:  the  PAL  imaging  block 
itself  and  the  foveal  lens  system 


Fig.  4.  The  virtual  images 
by  the  PAL  block  (annular  part), 
and 

by  the  foveal  lens 
in  one  common  image  plane 
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The  fourth  structural  element  is  the  relay  lens  system 

The  role  of  the  relay  lens  is  to  form  a  real  image  in  the  required  size  in  the  plane  of  the  sensor. 
There  are  a  lot  of  suppliers  offering  quite  a  wide  range  of  the  video  optics,  but  it  is  not  easy  to 
select  the  most  appropriate  ones  for  imaging  the  PAL  virtual  image  to  a  sensor  of  a  CCD 
camera  and,  at  the  same  time,  which  is  compact  enough. 

Earlier  the  so-called  finite  conjugate  micro  video  lenses  seemed  to  be  ideal  for  close 
proximity  applications  in  confined  areas.  Thus,  we  purchased  some  of  them  from  Edmund 
Industrial  Optics  (Barrington,  New  Jersey);  some  from  other  companies.  Unfortunately,  our 
expectations  to  get  images  of  appropriate  quality  have  not  been  realized.  The  explanation  is 
simple:  their  effective  diameters,  their  aperture,  are  too  small  to  collect  enough  image  forming 
rays  of  PAL  imaging  block.  You  have  to  be  aware  of  the  fact  that  not  the  whole  PAL  block 
takes  part  in  forming  an  image  portion  of  the  annular  image,  as  we  learned  about  the  common 
imaging  systems. 


_ 6 

EOARD  F61775-02-WE039  OPTOPAL  Panoramic  Metrology  Consulting,  Budapest,  Hungary 
SPC-02-4039 


33.0 


Final  Report:  A  Multipurpose  Foveated  PAL  Optic  Based  on  Humanoid  PAL 


i/>34.5 


it  32 


T" 


V 


A 


4^ 


Later  we  wanted  to  try  Schneider  Compact  VIS-NIR  Lenses,  which  were  described  in  Ed¬ 
munds  Catalog  2003.  (Page  224.).  Against  our  expectations  these  lenses  did  not  provide  us 
the  necessary  image  size. 


Then,  finally,  we 
lens  with  focal 
(1:1.4)  and  far  -  near 
mensions  permit  to 
which  connects  the 
the  rotatable  mirror 
modify  the  Computar 
upper  housing  was  re¬ 
mounting  element; 
Greguss  in  his  pre- 
previous  project  and 


EOARD  F61775-02-WE0 
SPC-02-4039 


have  found  the  Computar  H1214FI 
length  of  12  mm,  with  manual  iris 
focusing  capability.  Its  mechanical  di- 
fit  the  lens  into  the  glass  cylinder 
camera  parts  of  the  vision  module  to 
part.  To  be  able  to  do  this  we  had  to 
lens  assembly  in  such  a  way,  that  the 
moved  and  was  replaced  with  a  new 
similar  to  that  developed  by  Professor 
liminary  experiments  described  in  a 
reported  in  Final  Report  of  SPC  01- 
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4009. 

(see  Fig  1.  of  this  report). 


The  enhanced  vision  module  (including  the 
lens,  the  mechanical  components  and  the 
program  for  controlling  the  motor  that 
rotates  the  mirror)  with  characteristics  as 
specified  in  the  technical  proposal  was 
delivered  to  AnaLogic  Computers  Ltd.  (in 
care  of  Dr.  Akos  Zarandy)  at  the  address: 
AnaLogic  Computers  Ltd. 

13-17  Kende  Str. 

Budapest 

Hllll 

Hungary 

Phone:  +36  1-209-5400 
on  October  28,  2003. 


Edith  M.  Greguss  (Dr.  Pal  Greguss'  successor)  Pal  Greguss,  Jr. 

OPTOPAL  Panoramic  Metrology  Service 

Csfksomlyo  u.  4.  Budapest,  Hungary  H-1025 

Mailing  address:  Rona  u.  226,  Budapest,  Hungary  H-1 145 

Phone/Fax:  +36.1.363-1593;  Mobil:  06.30.588-2638 

e-mail:  qrequss@manuf.bme.hu,  qrequss.edit@freemail.hu 
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